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5or la^gel » elector (public or private^, course level (beginning cr 
^^dvancedl, and discipline (huin»nities/90c!al sciences/arts or 
':science/'fflatheffiatics/engf.neerf ng» • delation ships between the cognitive 
level of the professor's ques*ion and the overall cognitive level* of 
"both the professors' and s^-udents ere an»»lv2ed. The saople included 'JO 
professors in four inaJ:itjrt<.on?. Pour audio *apes were made per 
professor in the course "bf a semester. The tapes were analyzed 
according to the ftiidon Wult* pie category 5v?*eBr the Florida 
Taxonoov of Cognitive Behavior, and *he Rschr.er-Gallagher System. 
Statistical analyse^ of the results revealed that many of the classes 
were void of intellectual interchange between faculty and students, 
and lacked viaor. It^is proposed th»»t the technique of questienina -"s 
potentially more useful, and that facultv development programs could 
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-Xveryone who has ever, been to college probably feels he or she can des- 
cribe what "goes on" In college classrooms. However, thorough descriptive 
:5tudies of what actually takes place In these classes are rather scarce. 
It is eviUoiit that without an accurate picture of basic teaching-phsnom- 
ena, further research will lack the necessary theoretical support. 

The following study attempts to describe one aspect of the collegiate * 
teaching process— questioning--and focuses on the cognitive, levels and patterns 
xf professors' questions. The study tries to answer the following: 

1. What cognitive levels are elicited by the questions of college in- , 
s true tors? 

2. What questioning patterns are present in college instruction? Do 
these cognitive levels and patterns differ across: 

a. Institution types— private and public? 

b. Institution sizfi-small and large? 

c. Beginning and advanced courses? 

d. Subject areas— humani ties/arts/social science and nath/science/ 
engineering? 

3. In examining the data developed In the study: 

a. Is there a relationship between the cognitive level of the pro- 
fessor's questions and the general cognitive level of professor 
talk? 

b. Is there a relationship between the cognitive level of the 
professor's questions and the general cognitive level of 
student talk? 

Descriptive Research on Col lege Teaching 

Although rost professors declare that teaching! Ts their r^ajcr professional 
responsibility, relatively little research effort has been devotid to describing 



what transpires in the college classroom. That research which has been dot 
on the Instructional process is. limited and has yielded contradictory rf^'-s 
For example, when examining class size or structure In relation to student 
i^hlevement* it was generally found that class size 'Is not a critical variabte; 
no one general method of teaching produced more or better learning than another; 
and directed learning seems more effective than undirected learning. (Bigelow 
and Egbert, 1968; Dubin & Taveggia, 1968, Pullias, 1962). 

McKeachie (1970) examined collegiate instruction in considerable detail. 
Although his overall conclusions were in agreement with the above researchers, 
-he used a criterion other than student achievement, and his results were more 
definitive: for better retention, application, problem solving, attitude change, 
and motivation for further learning, small classes seem somewhat more effective 
than large, discussions are somewhat preferred over lectures, and student-centered 
instruction is generally preferable to teacher-centered. 

Research examining teaching in relation to different subject areas is also 
limited. The work of Solomon. Bezdek and Rosenberg (1964). Kenny (1967). and 
Maddox (1970) seems to indicate that differences in teaching procedures do exist 
with regard to discipline, but extensive work in this area is lacking. 

Studies comparing actual teaching behavior according to the level of the 
college course also appears to be sparce. Furthemiore, several studies • lich 
Investigated this variable on the Jr. -Sr. high school level often found contra- 
dictory results (Adams, 1964; Dahlberg. 1969; Goldbold, 1970; Moyer. 1965). 

Because there was so little descriptive research on collegiate instruction, 
the variables selected ."t^r this study were carefully chosen. Research on student 
rating of Instructors tends to show the potential value of instructor-student 
classroon interaction (Hartung. 1972; Mildebrandt. 1973; Kildebratidt, '.illson, 
and Dienst. 1971; Walsh, 1972; and others), and the research on class structure 
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suggests the .2;-e of discussions and student-centered instruction (KcKeachie, 
1970 and others). Consequently, instructor questioning seemed to be a yariable-^ 

jnight reveal .an accurate picture, of a portion of the collegiate insti^c- 

• *> - . 

tional process. 

This decision to study questioning beiijavlor is supporter* in studies of 
questioning in high school classes. Frequeiitly the researchers 'found that the 
great majority of all teacher questions were on the lowest cognitive level 
(Adams, 1964; Bellack, 1966; Davis & Tinsley, 1967; Rogers, 1972 and others), 
yet questions eliciting abstract thinking seemed to be the most effective for 
moving students to. ard high levels of understanding (Fur.»t, 1967; Gall, 1970; 
and others). 

In general, the great bulk of research over the century has suggested 
that in fosterinc 'he Important cognitive and affective outcomes to which colleges 
are con^nltted, the instructor's „questions may be a crucial factor. On both ele- 
mentary and secondary levels, questions have been shown to relatp to critical 
thinking, to achie ement, and to attitude toward the subject. On the college 
level, however, th-fr role in the teaching process has been only superficially 
evaluated. 

Given tne iiTi,.ortance of analyzing a professor's questions, then, one must 
certainly ask how -his behavior differ; across a multiplicity of variables. Does 
instructors' questioning behavior change over the course level? Among subject 
areas? Across institution size? Among institution types? This study attempted 
to shed light on ;:hese questions. 

Sample 

In order to generate broad descriptive data, the study included one school 
from each of tne following categories: large public, snail public, larfje private, 
sihall private. 



the schooU Included in the study were: 
#1 Urge public, enrollment, approaching 20,000 
.#2 Small public* enrollnient slightly less than e»000 
#3 Larpe private, enrollment over 10,000 ^ 
#4 Smaai private, enrollment less than 700 

There can never be a toUlly adequate sample, however, and one of the 
inadequacies of the current smaple concerns the range in the sizes of the in- 
stitutidns. Within the public and private categories, the range in size is 
sufficient. It was not possible, however, to maintain this range between cate- 
Tories. For example, the small public school is not substantially smaller than ^ 
the large private school. This must be taken into account when interpreting the 
data on the institutional size variable. 

Data Gathering Procedure^ 
From each of the small schools, 5 professors were ndonly selected; 
from each of the large schools 15 professors were randomly selected. No attempt 
was made to control for discipline. 

Each randomly selected^professor was telephoned to confirm his participatio 
in the study and to establish v^hich cliss would be audio- taped. In most cases, 
the professor had no preference, and this made it relatively sitr.ole to get an 
even distribution cf beginning and advanced classes. The dates for taping were' 
spread over the setrester; one tape was made during the first week of class, one 
during the week before final exams, and two somewhat equally spaced between these 

Considerable discussion was given to the Question of whether or not to 
inform the professors of the taping scnedule. Lamb (1970) studied the effects 
of three different observers* presence in the classroom on the auestioning pat- 
tern of secc-ivi year prcb.tionary teachers. He concluded t^^at different obser- 
vation conditions do not affect the questioning pattern of teachers except in 
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.•ne Instance; teachers observed for an expressed administrative purpose of 
: contract renewal asked a s*g„ff1cantfy higher nu.icr of opinion questions than ' 

teachers being observed for an Inservice purpose. Since this .tudy carried no 

overt threat, and since the professor had no knowledge of wh.- was being studied 
• other than "college teaching." ,t was assumed that knowing when he woujd be taped 

WQuld not appreciably affect his teaching. One portable cassette recor^ with 

an external condenser microphone was used. 

Thus the study involved a sample of forty professors drawn from a popula- 
'""-"'^^ Uhdergraduate faculty at four institutions. Thirty were from 

"large" s.chools, ten from "small" schools. . •. ' " 

Data Analysis Procedures 
Each tape was coded first using the flmidon Multiple Category System (MCS) 
(Appendix A). This data was then placed in , 24x24 .atrix (Appendix B) and 
percentages computed for each category. While coding the HCS for each question 
asked by a professor, the researcher coded a further breakdo.vn according to the 
Aschner-Gallagher Sys:e. for Classifying Thought Processes in the Context'of 
Classroom Verbal ,interaction (A G) (Appendix C). These observations were then 
recorded on the Aschner-Gallagher -tally sheet (Appendix D). A second researcher 
then coded a random »„p,e of at least t>.. tape, per professor using the Florida 
Taxonomy of Cognitive Behavior (FTCB) (Appendix E). Since each .ajor category 
of the FTCB contains several items, and the developers of the syste. not report 
that these are accurately sequential within the major categories, the total 
number of teacher and pupil tallies for each major category was co.outed. 

Thus for each professor, four MCS matrices, four A-G tally sncets. and at 
least two FTCB displays were available for analysis. 

The MCS matrices and coding sheets were then ex.r.ir.ed :o ascertain the 



professof**s questioning pattern. It posslble^to group these patterns 
into seventeen distinct groups* plus one group of "other"~pattems used 
very infrequently, drtd^e group of "no questions asked.*! 
• ^ ^ StatisticaT Procedures 

Several different statistical procedures were employed in examining the 
cognitive levels and questioning patterns: In dealing with the cognitive 
levels elicited by the questions of college instructors, frequency count, mean, 
and Simple T test were used. To describe the questioning patterns present in 
college instruction, a cross- tabulated frequency count was made. And a chi ' 
square was used to describe the differences in these patterns across the variables 
of institution size and type, course level, and discipline. S 

To determine the relationship between the cognitive level of professor 
questions and the general cognitive love! of teacher and student talK, a Pearson 
Correlation Coefficient was computed. 

Instrumentation 
Amidon Multiple Category System (Appendix A) 

This system Is a modification of the Flender's Interaction Analysis System. 
Sub-headings are added to six of Flander's categories and an eleventh category 
is added which braa'ts Flander's category ten (silence or confusion) into sep- 

0 

arate categories for each process. A person using the 24 categories described 
by the system enters the data into a 24x24 matrix Instead of the 10x10 matrix 
used by Flandj?rs. 

Category 1— Accepts Feelings, Category 5— Lecture, and Category 6— Gives 
Directions, are identical to Flanders* system. Category 2— Praises or Encourages, 
is modified to reflect Hughes' ideas about public and private criteria (Hughes, 
1959^. Cctegory 3-"Accepts of Uses Student Ideas, was mod1fii»d according to 
Taba's levels of thinking concept (Taba, 1964). It divides thought processes 
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into description* 4nference» and generalization.* The four major categories 
from Aschner and Gallagher's system— Cognitive memory, convergent, divergent, ' 
and evaluative-were used to modify Flander's category 4. Ultimately, these'* 
are based on Guilford's structure of the. intellect (Guilford, 1956). Further 
/discussion of these categories will oe given under the discussion of the Aschner- 
GlalUgher System. Category 7— Critiqizes or Justifies Authority, is modified 
In the same manner as Category 2. Categories 8 and 9~Student Responses, are 
modified in the Same manner as Category 3. Category 10 is now silence. Cate- 
gory 11 is confusion. 

Because of these alterations, it appeared that the use of Ami don's system ^ 
would yield a significantly more detailed description than weuld use of ttoe ^ 
more simple Flanders* system; this was especially important with respect to the 
questioning categories, as was noted previously. 

k eli abil ity— Light discusses the determination of inter- and intra-rater 
reliability with matrix systems (Ught, 1973, pp. 318-381). He notes that the 
simplest measure of agreement between two observers is to take the raw proportion 
of an agreement, but that this measure is independent of the observed marginals 
(p. 331). He suggests that a more appropriate measure of reliability in such cases 
is a variation of chi square, Cohen's K. 



f - f 

K = 0 _e where f^ = chance frequency 

N - f^ 
c 



He writes that 

K essentially compares the observed entries on the main diagonal 
with the expected entries on this diagonal, where the expected 
number of entries is comouted from the standard chi-square r.ul- 
tiplicative model of independence. It thus avoixis the probleni 

*The researcner experienced severe problcris witn the subscripts to category 
three and ultimately omitted these subscripts. 
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?r 5^1 ?tS^^®^*'^^.^^.^^!tS®P!r^"'"«s of observed .n,. nomber of responses 
" l2tC%' . .1; ' the j« column Trom exoected n^^ on the off-dtagonal 
cei.s. < takas the value of zero when observed adi^eenient equals exoec- ' 
ted agreenjent. and it takes tfie. value of KO wKen al? responses f I?] Sn 
haL fIL If^^^S^: It becon^es negative ivhen the observed responses 
-ofthe uble^Cp 33lf tts HmU depends upon the marginals 

• . . . t> ... ..." 

The need to use such a computation ^ther'than a, single proportion of agree 
ment is quite apparent when one considers that a great percentage of most* clashes 
Is teacher, lecture, and to ignore the fact that by pure chance one could obUin 
a v^ry high rffli^i!tty would render the computation invalid. 

Even though fs an extremely conservative measurai an inter-rater relia- 
abtlity of .31 and intra-rater reliability of .92 were obtained. These were 
cjonsidered acceptable. 

A ' . 

Florida Ta xonorr!'/ of Cognitive Behavior (Appendix B) 

The FTC3 is a sign s/stem (frequency of behaviors are not indicated, rather 
presence or absence af the behavior within a given tjine span) based on the the- 
oretical model developed* by Benjamin Bloom. It provides a fram«vork for observ- 
ing and recording th cognitive behavior of the instructor and students. 



AschfLer-Ganacner Sy.tem for Classifyino Thought Processes in the Cont ext of 
CTassroon Vg-bal Int ractlon ikov^f^ntiU ""-^ — ' — - ~ 

This instrumen-, was developed to assess the quality of thinking that is 
elicited and expressid in the classroom. There are five primary sets of cate- 
gories for classifyirg what is said and done in the classroom. Four of them, 
cognitive memory, convergent thinking, divergent thinking, and evaluative think- 
ing, are based gn the theoretical model of the operations of the intellect de- 
veloped by Guilford (1956). The Routine category contains be^^viors of interest 
to the developers wnlch were not Included in the above four groups. Each of 
'the five catscaries nas a set of subcategories. Sonre of these subcateaorlcs ere 
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In' using the A-G sy;Btem, the resfeancher has reversed the developers '^'^ 
ordfer of- the Evaluative and Divergent categories for easejn coding. Ihis 
reversal Irakis tHeT: parallel to the fICS 4a,b,c,d groups. 

Reliability- 'Aschner and Gallagher g4ve no instructions for computing 
reliability. Considering the nature of the present use of the system, a 
simple percentage agreSaent was considered sofflcient* The Inter-rater re- . 
itabijlty was .37; tbl^ intra-rater reliability was .93* 

RESULTS 
Genepal wescriptive Data 
Tfi< portion of total -class time spent in professor questioning was deter- 
mined by xiing the percentage in all subscripts of category 4 (Professors* 
Questions) on the Ani don Multiple Category System (MCS). Table l' illustrates 
both ir:eans and star sard deviations for each institution in the sample, for 
beginning and advar :ed courses and for the two discipline groups (humanities/ 
social science/arts and math/science/engineering). 



\ 
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TABLE 1 

• PERCENT OF TOTAL CLASS TIME 
SPENT IN PI^FESSOR QUESTIONING 





T 


S.D. 


N 


By Scnooi 


ff 




J . 


Large Public 


3.68 


2.97 




Small Public ^^'^ 


4.99 


3.32 


5 


Large Private 


2.44 


2.23 


15 


Small Private 


5s81 


8.49* 

m 


5 


Bv Dlscloline 






m. M J - * 


Math/Science " ' 


2.48 


2.28 


14 


Humanities/ 
Social Science 


4.27 


4.40 




By Level 




1 




Beginning 


'. 3.99 


4.50 


20 


Advanced 


3.30 ' . 


3.16 


26 


■ — 








Tot«l 


3.65 


3.85 


40 



Results ' 
The r'ange of the percents If total class time spent questioning was .03 

to 20.80. The values of .03 and 20.80 wece single cases. If these two cases 

are omitted, the range is . .20 to 9.20. 

There is no significant differencf 'in the 'mean percentage of the* total class 

time occupied by professors' questions across any of the variables examined. 



13 



y. • *^S^%.->rt -lit i--*^ 



ijr . ' Cognitive Levels Elicited by the 

Questions of Conene Professors 

~ The ABldon MCS was used to determine, the cognitive levels elicited by the 
questions of college professors. In this system, questions are ranked accord- 
=':t-<ng to the type of thinking elicited. Cognitive memory (4A), Convergent think- 
':^y:,-^im (4B), Divergent thinking (4C), and Evaluative thinking (40). The Following 
tables describe the percent of questions present In each qf these cognitive 

levels and how they vary across Institution type, size* course level « and dis- 

* ^» ■ * 

cipllne. 

TABLE 2 ' ' 



PERCENT OF TOTAL QUESTIONS IN EACH 
COGNITIVE LEVEL BY INSTITUTIOIiS 



Cognitive Questioning Level 







Cognitive 
Memory 
(4A) 


Convergent 
Thinking 
(4B) 


Divergent 
' Thinking 
(40 


Evaluative 
Thinking 
(40) 




Large Public 


80.13 - 


^ 15.42 


1.99 


'2.45 




Small Public 


91.51 


7.95 


0.28 


0.26 




Large Private 


81.95 


12.89 


3.60 


1.56 




Small Private 


80.33 


14.39 


2.80 


2.48 




Column X 


82.33 


• 13.40 


2.43 


1.85 



/ Results i 
/ . The overwhelming percentage of all questions asked by college professors, 
/* regardless of institution were on the lowest cognitive level (4A-Cognitive Mem- 
ory). The grand mean for this level was 82.33". With the exception of the 
small public institution, the means for level 4A were between 80 and 82f^. The 
small public college had a level 4A mean of 91.51*^^. 
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This sane aU:r1but1on was also seen across the levels of Convergent 
.thinking (4B), Divergent thinking (4C). and Evaluative thinking (4D): the 
Urse.fm?>Tlc» large private, and small private colleges appear fairly close 
f;1n percentages; whereas the small publfc school iJias-'conslstently fewer of the 
higher level questions. iv 

When using a t-tast to deteimlne the differences In cognitive level of ques- 
-tions between private and public Institutions, no significant differences were 
^^nd. Questlonlnc level is thus Independent of institution type. 

When grouping the Institutions as small. and large and performing a t-test 
to determine the difference In cognitive level of questions. It was found that 
questioning level 45 (Convergent thinking) dpes differ across the variable of 
institution size, with large schools having a significantly higher percentage of 
questioning time spant at the 4B level. i ^ ' 

Since there war little difference In the, individual cognitive levels of 
questions across the variables of institution size and type, ^ chi square anal- 
ysis was computed t3 determine whether discrete 1nst1tut1ons./were Independent 

... /■ 
of questioning level. ; * 

When conparing all four institutio' s over the four questioning levels. It was 
found that Institution Is, in fact, not independent of quifestioning level. Whereas 
a t-test did not Irdlcate a sjgnlflcan: difference for ekh one of the cognitive 

questioning levels Individually, taken together a lack pf Independent is shown: 

" - - ■ . 

= 27.0?, df ' 9. .01 (Appendix F) ; 

The large private institution has a high incidence of 4C (Divergent thinking) 
questions and the snialT public institution has a low incidence of 4C (Divergent 
thinking) and (Evaluative thinking) questions. 
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Qlfferences In Percent in Each Professor 
Cognitive OuestToning Level Between 
Beqinnini and Advanced Courses 



TABLE 3 

PERCENT OF QUESTIONS IN EACH 
PROFESSOR COGrilTIVE LEVEL BY 
BEGINNING AT^D AOVATiCED COURSES 



Questioninq Level 




Cognitive 
Memory 
f4A) 


Convergent 
Thinking 
f4B) 


Divergent 
Thinking 
(4C) 


Evaluative 
Thinking 
(40) . 


Beglnt^ing 


- 82.43 


12.71 


3.05 


1.81 


Advanced 




14.08 


1.81 


1.88 


Total 


82;33 


13.40 


2.42 


1.85 



Results 

When performing a t-test for difference between means in the questioning levels 
between beginning arid advanced courses no, significant difference was found/ It 
should be noted thct level 4A (Cognitive memory) is almost identical on the two 
levels and that levsT 4D (Evaluative thinking) is also almost identical. Level 
4C. (Divergent thinl ing) is somewhat hicher in the beginning courses but not sig- 
nificantly higher. 

T- tests of the differences in percent in each cognitive questioning level 
between beginning and advanced courses within each discipline group (science/ 
math/engineering and humanities/social sciences/arts) were also calculated. No 



significant differences were found on any questioning level. 
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Differences in Percent in Each Professor Coonltlve 
- Questioning Level Between Disciplines . 



TABLE 4 



PERCEfiT OF QUESTIONS IN EACH 
COGrUTjtVE lEVEL BY DISCIPLINE 



Questioning Level 



Cognipive 
Memory 
(4A 



Convergent 
Thinking 



Divergent 
Thinking 
(4C) 



Evaluative 
Thinking 
(40) - 



Humanities 



79. 7f 



14.40 



3.35 



2.51 



Math/Science 



87.0^ 



n.57 



0.73 



0.63 



Results 

Cognitive questioning lev^l 4A (Cognitive memory) is significantly different; 
<at the .03 level) between the| two major discipline groups— humanities and math/ 
science. In the math/science/^ngineering group professors asked significantly 
more low level (4A. Cognitive sknory) questions than did the humanities/social 
science/arts profe?sors (Table 4). It must be noted, however, that both groups 
essentially asked a high number ^f low level questions. 

On the other questioning leve\ls, however, no significant differences were 
foun^. 
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Alternative.rescriptive Data 
on Professor Questioning 



In order to examine the questioning behavior of; prafessors in a somewhat 
more detailed manne'* than was possible with the MCS, the Aschner-Gallagher system 
was eriploye!^ to analyze only the professor's' questions, not the entire class 
session. 

. This syste^tt in general. yields a more detailed breakdown of each subscript of 
the questioning \ate30ry (4) in the A'nidon MCS. 'Additionally it adds a fifth 
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category, "Routine." As noted In the description of the Instrumentation, the" 
WCS groups snosi ra-tine questions Into the 4 A {Cognitive memory) category, 
it treats rhetorical questions as lecture and humorous questions as 2A (Pra1se» 
■no criteria). The A-3 system brings both of these (rhetorical and humor) under 

■ ...... • , .... . ^ 

-the major heading "Routine"; eacl* has its own coding category. Although these 
differences account for only a small portion of the questioning, they do give 
a si igKlTy ^ff fcrent picture of professor questioning than the MCS gives. If 
a future researcher is particularly interested In routine questions as separate 
from cognitive metncry questions, he may wish to add this fifth category to the 
MCS. 

It inust also b; noted that with the MCS a single question may be tallied three 
times if it Is of nine seconds duration, whereas with the A-6 system questions 
are not tallied by duration but by a shift from one category or subcategory to 
another. Thus a n.ne second question calling for fact-stating would receive only 
o^e Cognitive ~£r:o*-y/fact stating code whereas in the MCS It would be coded as 
three Cognitive merory tallies' C4A, 4A, 4A). This account^? for the slight dlff- 
erences ir? percentages In the major categories. 



TABLE 5 

PERCENT" OF PROFESSOR QUESTIONING 
EPISODES IN f-tMjOR CMlcGOKiES 
OF ASCKNER-GALIAGHER SYSTEM 



t 


, Percent of Total 




Questioning Episodes 


Coanitlve f'enory (I) 


62.67 


— ^ 
Converoent Thinklnq (II) 


13.72 


Divergent Thinklnq (III) 


2.34 


Evaluative Thinkina (IV) 


2.50 


Pout in? (V> 


' 13.71 



Results 

It is seen that regardless of the classification system used, the majority 
all professors* questions are cn the lowest cognitive level. Using the 
-A-G systetn, it Is further noted that of those questions on the lowest level, 
56.10 percent of these are designed to elicit a statement of facts from the 
^^tudents. No other particularly unusual findings are seen. 

No correlations were made between the data obtained fr(m the A-6 system and 
the MCS or FTC3 systems. A-fi was used iiisply to provide a more descriptive 
analysis of the overall sample. 

Discussion of Results 
Cognltfve levels of. professors* questions 

A small portion of most college classes Is spent in profess'oFque^rhmtrig — 
(X = 3,65:-',- S.D. 3.26)t with little variation across institution type, size, 
course level, or discipline. This percentage is considerably lower than has , 
been observed -at the high school level. The percentage alone is not sufficient 
as an Index, hov/over, but juxtaposed with other variables which will be discussed 
later, this figure becomes. important. The great majority of the questions asked 
by professor- are. :t tha lowest cogn1t-:ve level (X = 82.33'0- I" ^act, over 
56% of all pro f esse rs'. questions ask for a simple recall of facts. ThesjB find- 
Ings are congruent wTth.past research questioning. 

Since the literuture on questioning suggests a relationship between pro- 
fessors' higher level questions and student outcomes such as achievement, posi- 
tive attitudes to'.vard the subject, and critical thinking, this may have impli- 
cations for faculty development. Because it is apparent that professors ask ' 
mostly vc'»7 Ic- level quc-stions, it appears thnt they are not generally utilizing 
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questioning to Its fullest extent. The current level may be effective for 
4tnowledge acquisition, but If critical th1nk1ng» for Instance, is valued as 
an outcome, then different levels of questioning need to be considered. It may 
be of, interest to future researchers :o study whether or not such outcomes as 
critical thinking and positive attitude are,Mn fact, stated goals, and to study 
whether or not professors' questioning differs in relation to the variability of 
these goals. - 

Added ta the problem of goals is that of Institutional type. In examining 
these data. It was found that although there appears to be no significant diff- 
erence In the cognUlve levels of professors' questions between public and pri- 
vate institutions, :here does appear to be a difference In professor questioning 
levels between sraali and large schools. A chi square analysis performed over 
the ent1i;e data sample showed that, questioning levels were not Independent of 
Insti tuti on ; that 1 s , they did - in f^et -d1 ffe<^-acn>ss-each separa te institut ion. 
One sees that professors at large schools ask more convergent thinking questions 
(such as "What is there about the position of New York City which accounts for 
its Importance?") than do professors at small schools which may indicate, as 
suggested earlier, a difference in institutional goals, or it may Indicate that 
professors are adapting their teaching to different types of students. Future 
researchers might be interested in how much Impact the academic or social char- 

I, 

acteristics of the students have on teaching. , ' 

< 

Although differences In professors' cognitive questioning levels were dis-^ 
covered between institutions, these were not present between beginning and ad- 
vanced courses. Not only was there no significant difference between course 
levels, but there was, in fact, a very close relationship. One might expect 
beginning courses to deal with more factual informat'on than advanced courses 
and for advanced courses to synthesize and relate these concepts 
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and to draw hypotheses and conclusions from theni but this did not happen. 
The study then tested the possibility that there was a difference in questioning 
levels between. beginning and advanced classes within each discipline group, 
ithe assumption being that in linear and sequential disciplines such as mathe- 
matics, science, and engineering, one might find more low level questions In 
the beginning courses and more high level questions in advanced courses. No 
questioning differences were found, however, between the course levels within 
the two discipline groups. Apparently orofessors* general questioning strategies 
do not change from beginning to advanced courses, regardless of the subject be- 
Ang taught. 

When examining the differences In questioning level between disciplines, the 
only variability was found at the cognitive memory level, with science/math/^ 
engineering professors asking a significantly larger proportion of low level ques- 
tions than the humanities/social science/arts professors. These results concur 
with those from oth3r studies: the disciplines of science, math and engineering 
put strong emphasis on the memorization of lov/ level concepts and facts. 

There are several possible, explanations for this heavy reliance on low- 
level questions: 1) low-level questions are by far the easiest to ask, ^) 
professors may often use low levcl^ questions. simply to "wake up" the class 
(such questions as '*Are you with me?" and "Did you all ,get that?" sometimes 
serve this function), 3) low level questions generally bring predictable re- 
sponses from the students and thus may create a more comfortable situation for 
-the professor, 4) professors may not recognize higher order questions. Thus, 
if the professor is actually attempting to facilitate critical thinking, for 
example, but Is uncomfortable with higher order questions Or cannot easily 
formulate then:, faculty developers may wish to include the topic of questionina 

t 
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in their prografus. 

Researchers may also find curvilinear relationship between critical think- 
ing, for example, and higher level questions. There may well be an optimum - 
proportion of high and low level questions and that either extreme is less 
than optimally productive. 

puestioning Patterns Present in College Instruction 
Another potentially impqsrtant aspect of questioning behavior is the ques- 
tioning pattern. What does a professor say immediately before he asks a ques- 
tion? What kind of question does he ask? What happens immediately after the 
question is asked? To begin to answer these questions, the primary (most frequent) 
and secondary (next most frequent) questioning patterns were isolated from the 
MCS tally sheets. These were combined into nineteen groups. 
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TABLE 6 



ORDER OF FREQUENCY OF SUMMED PRIMARY 
AfiD SECONDARY QUESTIONING PAHERNS 
OF COLLEGE PROFESSORS 





7:!.. 


5-4A-5 (5-4B-5) 




- -A 


5-4A-10-5 




3. 


5-4A-8-3-5 , 




4. 


5-4A-9-5 






5-4A-8-5 


- ' 


:::: 7.;6. 


5-4A-8-4 (5-4A-9-4) 




7. 


5-4A-9-2A-5 ( 5-4A-9-3-5) 




8. 


5-4B-3-2A-5 (5-4B-8-3-5) 




9. 


5-4A-8-2A-5 




.10. 


5-4A-10-4A 


■ -n. ..4 


11. 


5-4B-9-9-5 , 




12. 


5- 4A-^9- 3-4A( b ) ( 5-4 A- 8- 3-4A{ B ) 




12. 


5-4B-10-5 




14. 


5-4A-a-2A t3A)-8 (9)-5 




15. 


5-4B-8-2A-4 (5-4B-8-2A.-4) . 






5-4B-9-9-2A-3-9-5 






5-4A-10-10-9' 




18. 


No questions asked 



Legend 

2A = Professor praises 

3 « Professor uses' or 

accepts student Id^as iv 

4A = Professor -asks cognitive 
memory question 

4B « Professor asks convelrgent 
thinking question 

5 e Professor lectures 

8 = Student gives answer 
a question directed 
specifically to him 

9. = Student gives answer to/ 
a question which was 
asked of the total claj^s 
(a question vhich any, 
student was free to atiswer). 



10 = Silence 



\ 



\ 



19. Unusual patterns used only once. 



(A detailed cross tabulation of the frequency of each pattern across 
each institution, course level, and discipline may be obtained from the 



ERIC 



22 



. •• . ■ . \ 

researcher.) A brief description of the five most frequent patterns appears 
below. \ 

1. 5^4A-5 Professor lecture followed by cognltiye meiuory 

♦ * 

(5-4B-6) or convergent thinking question followed by 
■ ' - ' more lecture. 

2. 5-4A-10-5 • Professor lecture followed by cognitive memory 

question followed by silence followed by lecture. 

3. 5-4A-8-3-5 .Professor lecture followed by co|n1t1ve memory 

question followed by a restricted* student 
response followed by an acceptance or use of ^ 
the student's Idea followed by lecture, 

4. 5-4A-9-5 Professor lecture ft>l lowed by cognitive memory 

question followed by unrestricted** student 
- . response followed by lecture. 

5. 5-4A-8-5 Professor lecture followed by cognitive memory 

question followed by restricted student - 
response followed by lecture. 

Results 

The roust feequent questioning pattern ot college professors involves lec- 
turfng,-askingv a .low level question, and then lecturing some more. Often this 
return to lecturing af ter -a question was to give additional infonnation to aid 
the Students in answering the question. At other times the professors s.imply 



♦Restricted, student response - statement or answer to a question, 
directed specifically to a particular student. 

**Unre?tr1ctcd student response - statement or answer to a question which v;as 
asked of the total class and which any student was free to answer. 
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answered their own questions. It must be noted that these were not rhetorical 



questions, since rhetorical questions are coded as lecture with the MCS. 

insistent with both primary and secondary questioning patterns, the pro 
fessor's question followed a section of lecture. On occasion professor ques- 
tions would follow student responses, but these were not of primary or second- 
ary frequency. 



TABLE 7 



FIVE MOST FREQUENT SUMMED PRIMARY AND 
SECO.NDARY PROFESSOR QUESTIOrilNG PATTERNS 



Pattern 


Percent of Total Primary 


Number 


and Secondary Patterns 




. 18.03 


2 


13. £5 


3 


10.77 


. 4 


10.38 


5 


8.46 


Total 




, 1-5 


61.54 



♦ Thei.e five most frequent sunmed primary and secondary professor ques- 
tioning patterns accounted for 61.54?i of all patterns.- When summing patterns 
1 and 2, neither of which involve any student response, 31.93'i of all ques- 
tioning patterns of professors elicit no student participation. ^ 

Due to the small expected frequencies in patterns 6-19, further analyses 
were performed 'using only t)atterns 1-5. 
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Differences In Professors' Ougstioning 
Patterns Across Institutions 



TABLE 8 

FREQUENCY OF SWEO PRIflARY km SECONDARY 
QUESTIONING PATTERNS 1-5 BY INSTITUTION 



T 



Pattern Number 



Urge Public 
Small Public 
Large Private 
Small Private 



17 
12 
14 

4 



6 11 

9 4 

20 13 

1 0 



17 
1 

3 
6 



8 
4 

7 

3 



^ « 43.6329 df = 12 p .001 
Table 8 shows that with sunm|d primary and secondary questioning patterns 
1-5, questioning patterns are not independent of institutions ( p^ .001). ; • 
T. lar^e^rivate institution has a high frequency of patterns 2 and 3'and a 
moderate frequency of pattern 1. The large public institution has a high fre- 
quency of patterns 3 and 4. The small" public institution has a high frequency 
of pattern 1, and the small private has a high frequency of pattern 4. (For 
patterns descriptions, see page 26.) 



Differences in Professors' Questioning 
Patterns Across Course levels 

TABLE 9 



FREQUENCY OF SUHMEO PRIMARY AND SEC5NDARY 
QUESTIONING PATTERNS 1-5 BY COURSE LEVEL 



Pattern Nufrber 




12 3 4 5 


Bfeg inning ^; 


9 17 15 7 7 


Advanced 


•22 6 8 9 13 




« 14.8234 df = 4 p6. .01 


{ 
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Results ' 
Primary and secondary questioning patterns 1-5 were summed for beginning ^ 
^ot^ advanced courses. Table 9 suggests that the suinmed patterns 1-5 are not 
cindeperdent of ObMrse level (p^ .01). Beginning courses have wore patterns 
Z and 3; advanced 'courses have more patterns 1 and 5. ; 

7 ' • Differences In Professors* Questioning 

Patterns Across Disciplines 



TABLE 10 



FREQUENCY OF SU^ED PRIMARY ATiD SE(;oriDARY' 
QUESTIONING PAHERTiS 1-5 BY DISCIPLINE 

' ■ ■ ■ ■ . '% 



4 



Pattern Number 




1 


2 


3 




5 • 


Humanities 


17 


13 


14 




15 


Math/Science « 


14 


10 


9. 


9 


5 



.2.- 3.93515 « 4 pi .4 

Res'ul ts • . " ^ 

Prln^ry and secondary questioning patterns 1-5 were summed for the two 
discipline ri'f>»'ns From Table 10 it 1« clee** tHat even when comparing the five* 
fflost frequent patterns, questioning patterns are Independent of discipline. 
Discussion oV Questioning Patterns 

• The analysis of the questioning patterns present in college instructim- 
shows that the five most frequently used patterns accounted for 61.54!; of all 
questioning patterns. The first two o*^ these patterns accounted for nea,^ly"32; 
of all questioning patterns, and neither of them elicit any student response. The 
analysis of the fir?t five questioninci patterns indicated no differences ecross 
the two discipline groups. Differences wore found across institutions and course 
levels, howeve^. 
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r^" In the large private schools, professors had a higher frequency of 
■Pattern #2 (lecturfe— low level quest1on--silence-- lecture). In the large 

•public school, professors used a high frequency of patterns #1 (lecture— 
p9M level question-plecture) And #5 (lecture— low level question--unre.stricted 
^Student responser-lecture). 

The sroall public school professors had high frequencies of the first 
_ two! patterns (the patterns which elicit no student responses) . One might' 
-^hink that in a smaller school, because of its supposed Intimacy, professors 
-^uld conduct more student-oriented classes, calling on particular students 
^^o answer, praising their responses or using their ideas. This was not found, 

V-.-- • ^ 

Ijowever. , 

In the SQiall private. school, questions were more often addressed to the 
total class. In this school the most frequent pattern was #4 (lecture-*low 
level question— unrestricted student response— lecture). Seldom was a specific 
student called on respond in these classes. 

Differences ii questioning patterns v^ere also found between beginning 
and advanced courses. In beginning courses, professors wait more oVt .n after 
a questidn (pattern j?2: lecture— low level question— silence— lecture) , per- 
haps having more- pctience with the beg'nning student. They also tend to call 
on specific .students (pattern #3: lecture— low level question— restricted 
student response— i >e of student's ideu— lecture) and accept or use the stu- 
dents' ideas more often. 

Professors in advanced courses, on the other hand, tend to use pattern 
#1 (lecture— low level question— lecture) and pattern «5 (lecture— low level 
question— restricted student response— lecture) more frequently. The higher 
frequency of these patterns may suggest that the material is more difficult 
and thus each question needs elaboration before the student can answer it. 
The restricted student responses may suggest that by the advanced courses, 

• _ ■ ■ ^ ^ 



--.|>rpfessors know rhe students' names and call on specific people, rather than 
addressifig the question to the class as a' whole. 

The general finding that professors seem to rely on fairly restrictive 

I^Questlpning patterns those eliciting no student response or those which 
are a simple lecture— question-r^answer— lecture sequencer-might imply that 
professors are not aware of the potential of thetr own questioning' patterns. ^ 
During conferences with several of the professors in the study, most indicated 

^they had never given any particular thought to this aspect of the questioning 
jjroc^ss and consequently relied on a few patterns which seemed comfortable to 
th@n. 

Although the potential impact of questioning pattern has not yet been 
determined* it seems possible that what precedes and follows a professor's ^ 
question may well cetermine how that question affects students. That is, the 
pattern "lecture— low level question— student response— lecture" may give the 
impression that the professor is checking up on the students* preparation for 
the class; whereas if the professor* followed the response by an elaboration of 
the student's idea, it might suggest that he was attempting to involve students 
in the actual content of class session—two totally different strategies. The 
sequence of questions over a class period may also be an important area for 
investigation. 

t I V - 

• • • 
» 

Relati onship Betw r-^ n the Cognitive Level of 
P rofessors' Que st ion s fncT the Gene ral 
Cognitive Uvg " "' of Pro fessor Verbal 
Behavior and Scudent \^ r"b 3l Behavior 

Since the literature on questioning in elementary and secondary education 
seemed to point to a relationship between student thinking skills and/x)r 
achievement and the cognitive level of the teachar's questions. I attempted 
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to relate the cognitive level of professors* questions as measured by the 
^^^ildon MCS to both student and professor cognitive levels as measured by the 

A Pearson Correlation Coefficient* was calculated between each cognitive 
<luest1onin9 level of each professor (4A,B,C,D) on the MCS and each professor's 
^Weclflc cognitive levels (1.0 to 7.0) as Identified by the FTCB. »No significant 
correlations were found between questioning levels 4A or 4C and any cognitive 
level of professors. 

— Two possible relationships were found at each of the 4B (Convergent thinking) 
and 4a (Evaluative thinking) levels. 4B showed a positive correlation with 
professor cognitive level 3.0 (Interpretation) (r « .3354, p = .OOSf; it also 
showed a positive relationship with level 4.0 (Application) (r = .9009,* p = .018). 
Questioning level 4D (Evaluative thinking) was positively related to cognitive 
level 2.0 (Translation) (r « .4475, p » .027); it was also positively related to 
cognitive level 3.0 (Interpretation). , 

It must be noted, however, that since a 4 x 20 table was computed, by chance 
one would expect to obtain four correlations significant at the .05 level— the 
exact number obtained. Thus one must regard, these significant correlations with 
caution. 

The same calculations were performed between professor's cognitive ques- 
tioning level and student cognitive level. No significant relationships were 
found. 

*Note: Labovitz (1970) Indicates that even if assumptions concerning equal 
interval data are violated, as they are in this study, the Pearson r may still 
be used. It is a .:iore powerful statistic than the Spearman Rank Order or the 
Kendal and the results are nearly identical. This was tested and found to be 
true in this study. 
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Correlation Between level of Professor's Questions 
and Modal and Median Professor Cognitive level 



s'.' ;:->■« .J... • 



r 
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TABIE n 

PEARSON CORRELATIOn'cOEFFICIENT BETWEEN 
COGNITIVE LEVEL OF PROFESSOR'S QUESTIONS 
(BASED ON MCS) ATID MODAL PROFESSOR 
• COGNITIVE LEVa (BASED ON FTCB) 



Questioninq Level 


* Cognitive 
Memory 
r4A) . 


Convergent Di vergent 
Thinking Thinking 
(4B) (40 


Evaluative 
Thinking 
(40) 



•0541 
147 
.258 



.0785 
102 
.216 



.0083. 

33 
.482 



.0224 

28 
.455 ' 



TABLE 12 



PEARSON CORRELATION COEFFICIENT BETWEEN 
COGNITIVE LEVEL OF PROFESSOR'S 
. QUESTIONS AND MEDIATI PROFESSOR 
COGNITIVE LEVEL • 



Questioning Level 




Cognitive 
Memory 
(4A) 


Convergent 
Thinking 
{4B) 


Divergent 
Thinking 


Evaluative 
Thinking 
{4D) 


Professor 
Medi an r 


-0.1436 *. 


0.1876 


0.1072 


-0.0989 


N 


14/ 


102 


33 


28 




e .041 


^ .0?9 


^ .276 


^«308 
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Results 

Correlations were computed between the modal cognitive level for each 
^professor arid the questioning level of that jarcfessor. No significant re- 
)lationships were found (Table 11). When comparing the median professor cogni- 

tive* level with the level of professors' questions, soroe relationships were 
-found however. In TaWe 12 It Is seen that as the median' professor cognitive 
llevel goes up, the frequency of questions In level 4A (Cognitive memory) goes 

clown; and as the median professor cognitive level goes up, the frequency in pro 
= fessor questioning level 4B (Convergent thinking) goes up. Thus It se^ms that 

professors* questioning is related in some respects to their overall cognitive 

l^vel. 

Correlation Between Level of Professors* 
Questions and I'odal and ''edian 
Student Cognitive level 



TABLE 13 



PEARSON CORRELATION COEFFICIENT BETWEEN 
COGNITIVE LEVEL OF PROFESSORS' QUESTIONS 
AND MODAL STUDENT COGNITIVE LEVEL 



Questioninq Level 




Cognitive 
Memory 
{4A) 


Convergent 
Thinking 
(4B) 


Divergent 
Thinking 
{40 


Evaluative 
Thinking 
(4D) 


r 


-.2362 


.19 


.3394 


.1952 


H 


147 


102 


33 


28 




.002 


.028 


.027 


.16 
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Results 

»•.■.. 

When comparing the modal student tognitive level and the professor ques- 
^^vUoiUng levels, several possible relationships were revealed (Table 13). It 
■^s seen that as the percent of professor questioning In level 4A''(Co3h1t1ve 
l^toiory) Increases* the cognitive level of the student tends to decrease 

(r = -.2362..P = ,002). As the percent of professor questioning at the 4B 
^ level (Convergent thinking) increases, the student cognitive level tends to 
increase (r « .19* o f .028). As the percent of professor questioning at the 
"4C (Divergent tliinking) lev^l increases* the student cognitive level tends to 
Increase (r = ,3394, p = .027). Thus v/hen viev^ing the modal student cognitive 
level, it appears to^be positively correlated with the level of the professor's 
questions. 



TABLE 14 • 



PEARSON CORRELATIO:: COEFFICIENT BETWEEN 
COGNITIVE LEVEL OF PROFESSOR'S QUESTIOriS 
AND MEDIAN STUDEIJ COGNITIVE LEVEL 



Ouestioninq Level 


* 




Cognitive 
Memory 
(4A) 


Convergent 
Thinking 


Divergent 
Thinking 
(4C) 


Evaluative 
Thinking 
(40) 


Medl an 
Student 


r 


-0.1894 


0.1133 


0.2415 ' 


-0.1417 




N ■ 


147 


102 


33 


28 




. P., 


.on 


.128 


.088 


.236 



When comparing the median student cognitive level with the cognitive level 
of professor's questions, a significant relationship is seerx only In the 4A 
(Cognitive meniory) category. As the frequency of professors' low level (4A) 
questions goes down, student cognitive levels c;o up. 
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Discussion of ,feUt1onsh1p of Cognitive Level 
of Professors* Questions to the O/eralV Cognitive 
V . level of Professors and Students ^ 

When examining the association of the level of a professor's questions 
to both his and the students' overall cognitive levels, a positive correlation 
Was found between the cognitive level of the professor's questions and both 
*is and the students* overall co5[n1t1ve levels. An Inverse relationship was 
found between the professor's frequency of low level questions and both his 
and the students* overall cocjnitlve levels. 

These relationships were more clear at some .cognitive levels than at others, 
however^ and were hot found to exist across all variables* For examplet when 
comparing each single professor and student cognitive level with each single 
professor questioning level, relationships were found only between 1) a pro- 
fessor's convergent questions and the cognitive levels of Interpretation and 
application and 2) his evaluative questions and the cognitive level of translation. 
However, even these may be suspect because of the number of comparisons made. 
Using this single comparison model, no relationships were found betv*/een any 
one cognitive level of students and any one level of the professor's questions. . 

On the other hand, when computing both modal and median scores of the over- 
all professor anu student cognitive levels and comparing these to the cognitive 
levels of the professor's questions, there were several significant relationships. 
These measures of central tendency yielded an overall picture of the cognitive 
level of each class depicting more accurately the differences between classes. 
Thus they revealed relationships not found when comparing each single cognitive 
level and each questioning level. Consequently one might conclude that there 
appears to be some relationships between the cognitive level of professors' 
questions and the overall cognitive level, of the class, but the exact nature of 
this relationship is not totally clear. 
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In this stu(5y the specific relationships which were found between the 
professor's overall cognitive level and the levels of his questions were: 
1) as the percent of a professor's low level questions goes down, his median 
""cognitive level goes^up, 2) as the percent of the professor's convergent think- 
ing questions goes up, his median cognitive level goes up,. No relationship 
^s found between professor luodal cognitive* level and professor questioning ^ 
4evel . 

« . . * . a 

The specific relationships between the overall student c^ognitive level and 
"the professor's questioning levels were generally consistent with the findings 
concerning overall professor cognitive levels. It was found that 1) as the 
percent d'f professors' low level (cognitive memory) questions increase,, the - 
students* median and modal cognitive levels decrease, 2) as the percent of 
professors' convergent thinking questions increase, modal student levels in- 
crease, and 3) as the percent of professors' divergent questions increase, modal 
student cognitive Isvels increase. ^ 

Summary of Results* . 
While a variety of descriptive Information was obtained from this study., 

r 

the following see.i co be the most Important findings: 

1. A very small portion of most coTlege classes is spent in professcxr 
questioning (X = 3. 55*^.). This percent of time spent questioning does not vary 
significantly across institution type, size, course level, or discipline. 

2. Of the questions asked by college professors, the great majority are 
at the lowest cognitive level (X = 82.33:.'). 

3. There appears to be no significant difference in the cognitive level of 
professors' questions between public and priviste institutions. 

% 
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4. When c(»Qpartng questioning levels of professors according ^to the size 
of the Institution, only level 4B (Convergent thinking) appears-to differ: 
'Urge school professors ask significantly ir>ore convergent thinking questions 
sthan do small school professors. 

5. In an overall chl square analysis of Questioning levels, questioning 
level is not independent of the individual Institutions In the sample. 

6. Questioaing level is not only not significantly different between . 
|>eginning and advanced courses, but is surprisingly similar across the course 
levels. 

?• Questioning level varies between disciplines only at the Cognitive 
memory (4A) level, with science/math/engineering profes^e^ aslcing sigftiflcantly 
fliore low level questions than humanl ties/social selves/arts professors. 

8. Primary questioning patterns do not vary significantly across institu- 
tion size, type, course level, or discipline. 

9. The most coisnon questioning pattern is professor lecture followed by a 
low level (Cognitive memory) question followed by more lecture. 

10. Five questioning patterns account for 61.54% of all primary and secondary 
questioning patterns of college professors. 

11. 31.93:; of all questioning patterns of, college professors in this sample 
elicit no stiidant pjrticipation. 

12. Summed primary and secondary patterns 1-5 are not independent of In- 
stitution or course level, but they are independent of discipline. 

13. ''hen comparing each professor and student cognitive level with each 
professor questioning level, few relationships are found. 

' 14. When comparing the modal professor cognitive level with the professor's 
questioning level, no significant relationships were found; but coirparing the 

35 



median cognitive level of the professors witii questioning levels revealed 
that professors* median cognitive levels decrease as their low level questions 
increase, and their median cognitive levels increase as the frequency of their ^ 
convergent thinking quest ions increase. 

15. As the frequency of professors' questions in the 4A (Cognitive memory) 
level increases, the modal stude?)it cognitive level decreases. As the frequency 
in professor questioning level 4B (Convergent thinking increases, ^the modal 
student "cognitive '.avel increases. 

16. As the frequency of pfofessors' questions in level 4A. (Cognitive 
memory) increases, the median student cognitive level decreases. 

CONCLUSIONS . ' * 

•This study of the questioning behavior of college professors' was designed 
to generate basic descriptive data on the questioning process in college in- 
struction. No causj and effect relatiooships were sought nor were teaching 
processes evaluated; rather, the study provided precise descriptive data on 
professor^ quest 1 oni ng and a basis for further research. 

As a result of the study, several questions arise. Probably most fundamental 
is why are the majority of the professors* questions at such- low cognitive 
levels? . Second; why are significant differences found among institutions? Is 
it simply a matter of institutional goals or are different types of students 
responsible? Do small public institutions ignore the goal of critical thinking 
or do they simply have less able students? 

Another aspect of the data which merits attention is the great similarity 
of questioning between beginning and advanced courses. Seemingly one v/buld 



expect begioaing coiirses to deal with more factual information than advanced 
ones, and for advanced courses to attempt, then, to synthesize and' relate 
concepts, to draw hypotheses and conclusions; but this did not happen. Fur- 

-therroore, there was no difference in questioning levels between beginning and 
advanced classes within each discipline group. Apparently professors' general 
questioning, strategies do not change from beginning to advanced courses re- 
gardless of the subject being taught. Needed, though, are studies examining 
courses taught by the same professor at both beginning and advanced levels. 
Perhaps each individual professor does change questioning strategies, but that 
these differences are burled by computing grou{5 means. 

Also of potential interest is the possibility of a curvilinear relationship 
between outcomes such as critical thinking, and higher level questions. It 
may^vel-rbe that there is an optimum proportion of high and low level questions 
to reach this gdal, and that either extreme is less than optimally productive. 

In examining the data on the relationship of the cognitive levels of student 
and professor, two additional questions a-lse; foremost among these is why is 

'there an apparent lack of relationship between the highest levels of professors' 
questions {diverger.t and evaluative) with any general cognitive levels? It 
may well be that due to the low frequency of professors' questions at these 
levels, significant relationships will be difficult to uncover and that controlled 
experiments will be necessary to investigate this relationship further. Second, 
because of its methodology, this study could not reveal which is the "dependent 
variable: do higher student and prbfessor general cognitive levels cause the 
professor's cognitive questioning levels to rise, or do higher level professor 
questions cause the overall cognitive levels to rise? This certainly 'needs to 
be detorrnncd. 
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In general^ then, when viewing the questioning process In the college 
classroom, one sees, that professor questioning occupies a very small portion 
:mf- the total class time, the cognitive level of the professors* questions Is 
^usually yery 1<»^, but appears to be related to overall cognitive level 'of both 
professor and students; and of^ professors* questionins, patterns elicit no 
student. response. Overall there are very fe^ siajor differences in questioning 
across any of the variables Examined. Additional studies of questioning pat- 
terns are warranted 4n which causal relationships betasfeen levels of questioning^ 
ind student achievement may be established. 

' Definition of Terms 
The following terms used throughout the study require definition: 

1. Teaching behaviors: According '1» I^ans (li60)„ behavior can be defined 
as "the activity of a person as they (sic) go abo^dolng whatever is required 
of teachers, particularly those activities concerned with guidance— direction 
of the learning of others (p. 15)." For tMs study, teaching behavior will 
include whatever the teacher did or said during a designated class session. 

« 

2. Question: Any verbalization which either semantically or contextually 
calls for an answer from another person. 

3. Cognitive l2vel: The level of intellectual functloninj; exhibited by 
teacher or student. Based on the work of Benjamin Bloom (1956), this is 
sequentially arranged from the lov/est level (knowledge) to the highest (eval- 
uation). The higher levels are presumed to Involve more complex and abstract 
thought processes than the lower levels. 

4. Questioning pattern: The sequence of teacher and student verbal behavic 
v/hich occur before, during and after a teacher question. Ror example, teacher 
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lecture (5), followed by te^cl(ier low level question (4a), followed by re- 

^ , 1 ^ . > ■ 

strlcted student response (8)i followed by teacher lecture (5) Is depicted 

. ].. . • ^ ... 

as a q|uestioa1n9 pattera.5-4a-|B-5. 

5^ Verbal Interaction: T^lk between two or more people*. 

6. Teacher talk: All teacher verbalizations. ^ . 

7. Student talk: All student verbalizations. 

8. Cognitive memory question: A question which attempts to elicit thought 
-processes such as recognition, rote memory, and selective recall; e.g. "What 

Is the largest city in New York State." 

9. Convergent thinking question: A question which attempts to elicit 
thought processes whiqh Involve reasoning b^sed upon given and/or remembered ^ 
data; e.g. ''What Is there about the location of New York City which accounts 
for its importance?" , 

10. Divergent thinking question: A question which attempts to elicit thought 
processes from a deilnite but "data poor" framework or structure. The respondent 
generates his own ideas or associations in response to the question. There is 

no uniqijely right or. correct answer to such a question; e.g.*, "Suppose that 
starting tomorrow tiiere were no Institutions called 'schooU ' How will this 
change your life?" 

11. Evaluative thinking question: A question which attempts to elicit 
thought processes of a judgmental rather than a factual nature; thought pro- ^ 
cesses which deal with matters of value not fact. "Do you think school is 
useful?" What or why not?" 

12. Routine question: A question which .attempts to elicit reaction to the 
day-to-day direction and conduct of the class. Also included are those verbal 
inanueverings which modify the course or direction of a discussion, e.g., 
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^«ow many of you brought your work books to class today?" 

' y • / Epi logue ^ - ■• . . 

Our sense, of jBythology- suggests that in colleges one would expect to 
find inquiring young minds being chal^ngecl by the intellectual and' perceptive 
questions of gleamed professors— extensive Socratic dialogues and active • 
int,erchange of ideas.. In this respect, the findings of this study were dis- 
:^poi|fiting. Not only were many of the classes void of Intellectual Interchange 

, . ■ • ; . ♦ 

between professor and stu(tents, but they also lacked excitement and vigor. One 
0f the primary ^ooU at the professor's disposal %q infuSe this atmosphere in\o 
his classroom is questioning, an age-old.tephnique but one which has not yet 
been tapped for its full poteiAial. 

* Since faculty development is curren^tly in vocjue in many institutions of 
higher education, it 'seems -justified that such development Include an analysis 
of questioning patterns in college classrooms. This. study, although not ex- 
haustive, does suggest topics for study in fadulty development. It may be 
that questioning levels and patterns are not what Is i4>ortant, that instead 
we should 'look harder at cognitive levels. The main point howeVer; is that 
today little of the actual teaching process is being ex*amined at all. The 
results of this study clearly indicate that whatever we acMeve with faculty 
'development could not be any worse than what we are doing; t^fi^bV^ We may 
be in' a situation where ft is better to be inef.fcctive and trying\han to be 
ineffective and not trying. ... ) 
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